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Mathematical Background 
Sastry, Chapter 3 


x= f(x) x(0) = x0 (1) 
Do solutions exist? Are they unique? 


¢ If f(-) is continuous (C°) then a solution exists, but C° is not suffi- 
cient for uniqueness. 


Example: x = x3 with x(0) =0 


3 
2\3 
3) are both solutions 
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oo slope 
at x=0 


¢ Sufficient condition for uniqueness: “Lipschitz continuity” (more 
restrictive than C°) 


lf(x) — fly)| < Llx—y| (2) 


Definition: f(-) is locally Lipschitz if every point x° has a neighbor- 
hood where (2) holds for all x,y in this neighborhood and for all t for 
some L. 


Example: (-)3 is NOT locally Lipschitz (due to oo slope) 
(-)3 is locally Lipschitz: 


Py = (x? +xy+y’) (x-y) 
in any nbhd 
of x9, we can 
find L to upper 
bound this 
= | -y| <L\x—y| 
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* If f(-) is continuously differentiable (C'), then it is locally Lips- 
chitz. 


Examples: x3, x?,e*, etc. 
The converse is not true: local Lipschitz # C! 


Example: 


Not differentiable at x = +1, but locally Lipschitz: 


| sat(x) —sat(y)| <|x—-y|  (L=1). 


Definition continued: f(-) is globally Lipschitz if (2) holds Vx,y € IR" 
(i.e., the same L works everywhere). 


Examples: sat(-) is globally Lipschitz. (-)° is not globally Lipschitz: 


— slope getting steeper 


* Suppose f(-) is C!. Then it is globally Lipschitz iff 94 is bounded. 


L = sup If’ (x)| 


2 
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Preview of existence theorems: 


1. f(-) is C° ==> existence of solution x(t) on finite interval [0, t,). 
2. f(-) locally Lipschitz => existence and uniqueness on (0, t,). 
3. f(-) globally Lipschitz => existence and uniqueness on [0,00). 


Examples: 


¢ x = x? (locally Lipschitz) admits unique solution on (0, t f), but 
tr < co from Lecture 1 (finite escape). 


e x= Ax globally Lipschitz, therefore no finite escape 
|Ax — Ay| < L|x—y| with L=||Al| 
The rest of the lecture introduces concepts that are used in proving the 


existence theorems mentioned above. 


Normed Linear Spaces 


Definition: X is a normed linear space if there exists a real-valued 
norm | - | satisfying: 

i. (x 20 yee, |x| S Ua v=o. 

2. |x+y|<|x|+ly| Vx,y € X (triangle inequality) 


3. |ax| = |a|-|x| Va € Rand x eX. 
Definition: A sequence {x,} in X is said to be a Cauchy sequence if 


|x, —Xm| > 0 as k,m > oo, (3) 


Every convergent sequence is Cauchy. The converse is not true. 


Definition: X is a Banach space if every Cauchy sequence is conver- 
gent. 


All Euclidean spaces are Banach spaces. 
Example: 


C" [a,b]: the set of all continuous functions [a,b] > R" with norm: 


[xlc = max |x(t)| 
te [a,b] 


1. |x|c > 0 and |x|c = 0 iff x(t) =0. 
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2. |x+ylco = max |x(t) + y(é)| < max {|x()| + ly(I} < Ixle +lylc 
t€[a,b| teE [a,b] 


3. |a-x|c = max |a| - |x(t)| = |a|-|xlc 
t€ [a,b] 


It can be shown that C"|a, b] is a Banach space. 


Fixed Point Theorems 


T(x) =x (4) 


Brouwer’s Theorem (Euclidean spaces): 


If U is a closed bounded subset of a Euclidean space and T: U + U 
is continuous, then T has a fixed point in U. 


Schauder’s Theorem (Brouwer’s Thm — Banach spaces): 


If U is a closed bounded convex subset of a Banach space X and 


T : U > U is completely continuous’, then T has a fixed point in U. * continuous and for any bounded set 
BC U the closure of T(B) is compact 
Contraction Mapping Theorem: 


If U is a closed subset of a Banach space and T : U — U is such that 
IT(x)-TY)| Selx—y| p< 1 Veyeu 


then T has a unique fixed point in U and the solutions of x,41 = 


T(x) converge to this fixed point from any x9 € U. 


Example: The logistic map (Lecture 5) 


T@) ==) (5) 


with 0 < r < 4maps U = [0,1] to U. |T’(x)| <r Vx € [0,1], so the 
contraction property holds with p = r. 


r/4 


Ifr < 1, the contraction mapping theorem predicts a unique fixed 
point that attracts all solutions starting in [0,1]. 


EE C222/ME C237 - SPRING’18 - LECTURE 6 NOTES 5 


Proof steps for the Contraction Mapping Thm: 


1. Show that {x} formed by x41 = T(xn) is a Cauchy sequence. 
Since we are in a Banach space, this implies a limit x* exists. 


2. Show that x* = T(x*). 


3. Show that x* is unique. 


Details of each step: 


7 [Xn41 — Xn] = |T (Xn) — T&n-1)| S pen — Xn—1| 


< geome = Xn—-2| 


< p"|x1 — Xo]. 


Xn-+r — Xn| < \Xn+r — Xn+r—1| a |Xn41 — Xn| 
< (pl 4-4 p")lan — x0 
= pX(1+--+ 6") — 2 


=~ 


ig 


as 
Since = — 0 as n > ©, we have |Xn4- — Xn| 4 0 as n > ov. 


2. |x* — T(x*)| = |x* — an + T(xn-1) — T(x*)| 
< |x" — xn] + [T(%n-1) — TOX*)| 


< |[x* — x,| + p|x* — xn_1]. 


Since {x} converges to x*, we can make this upper bound ar- 
bitrarily small by choosing n sufficiently large. This means that 
|x* —T(x*)| =0, hence x* = T(x"). 


3. Suppose y* = T(y*) y* Ax". 
|x* —y*| = |T(x*) —T(y*)| s elx* —y*| =e x* = y"*. 


Thus we have a contradiction. 


